Particle-hole condensates of higher angular momentum in hexagonal systems 
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Hexagonal lattice systems {e.g. triangular, honeycomb, kagome) possess a multidimensional ir- 
reducible representation corresponding to d^2_y2 and d^cy symmetry. Consequently, various phases 
that break time-reversal and spin rotation symmetries can occur. We show that hexagonal lattice 
systems with extended repulsive interactions can exhibit instabilities in the particle-hole channel to 
phases with d^2_y2 + id^y symmetry. When lattice translational symmetry is preserved, the phase 
corresponds to nematic order in the spin-channel with broken time-reversal symmetry, known as the 
P phase. On the other hand, lattice translation symmetry can also be broken, resulting in various 
dj.2_j,2 -I- idxy density wave orders. In the weak-coupling limit, when the Fermi surfaces lie close to 
a van Hove singularity, instabilities of both types are obtained in a controlled fashion. 
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Introduction.- Correlated electron materials often ex- 
hibit a tendency towards forming multiple, competing 
phases including superconductivity, density waves, and 
phases with orientational order. In the weak-coupling 
limit, the set of all possible broken symmetries is de- 
termined by symmetry alone; each is labeled by an al- 
lowed irreducible representation (irrep) of the symmet- 
ric normal state. When symmetry allows for higher di- 
mensional irreps, phases that spontaneously break time- 
reversal and/or spin rotation symmetry can occur. Ex- 
amples include a, ipy superconductor in a tetragonal 
system, or the B-phase of Helium-3 in a cubic crystal. 
The former breaks time-reversal, whereas the latter rep- 
resents a phase with broken spin rotation symmetry, i.e. 
an example of dynamically generated spin-orbit coupling. 

Here, we study systems with hexagonal symmetry. 
There, d3.2_j^2 and d^;}, irreps are degenerate, forming a 
two-component irrep This allows for the possibility 
of d + id superconductivity, which spontaneously breaks 
parity and time-reversal symmetry |2t6[. However, this 
is not the only possibility: hexagonal systems can also 
naturally allow for particle-hole condensates with d + id 
symmetry. When such a system preserves lattice trans- 
lation symmetry, the state is known as a /3 phase 0: an 
electron nematic state in the spin channel, which spon- 
taneously breaks time-reversal and spin-rotation symme- 
try. In this phase, spin orbit coupling is generated dy- 
namically . When the particle- hole condensate breaks 
translation symmetry, it is known as a d+id density wave 
phase and can occur either in the spin singlet or triplet 
channel Q. 

In this paper, we demonstrate the existence of both 
the j3 phase, and d -\- id density wave ground state on a 
triangular lattice. We show here that both phases arc sta- 
blilized in the weak-coupling limit when the Fermi surface 
is tuned to cross a van Hove singularity. In such a limit, 
there is an instability to each of these phases allowing the 
use of an unrestricted Hartree-Fock treatment. Although 
this fine tuning is required to access the instabilities in 



a controlled fashion, it is likely that such phases survive 
away from the van Hove filling in the experimentally rel- 
evant intermediate coupling regime. We also study the 
transition between the two phases as the degree of Fermi 
surface nesting is altered. Since both phases represent 
particle-hole condensates of higher relative angular mo- 
mentum, they require longer range interactions in order 
to be stabilized over their zero angular momentum coun- 
terparts - namely ferromagnetism and spin density wave 
phases, respectively Since the considerations be- 

low are based solely on symmetry, the results are also 
appropriate on other hexagonal lattices such as the hon- 
eycomb and kagome, as has been confirmed by recent 
studies [i,[lil-[i6|. 

Extended Hubbard model.- We consider spinful fermions 
hopping on a triangular lattice, with nearest and next 
nearest neighbor (nnn) hopping strengths, ti and t2, and 
an onsite and nearest neighbor density-density interac- 
tion. The Hamiltonian is 
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where ni„ = cl^c^^ is the density operator for 
electrons of spin a, at site i. The dispersion 
is Ek = — 2ti [cos fca; -I- 2 cos (fc^/2) cos (VSfcy/S)] — 
2^2 [cos \/3fci/ + 2 cos (3fc2;/2) cos (-\/3fcj,/2)] and there is 
a logarithmic divergence in the density of states at the 
van Hove filling of /i* = 2 {ti + t2). Fourier transforming 
the interaction yields 
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From symmetry considerations, it follows that /^k'' 
which are lattice analogs of Landau parameters, can be 
written as a sum of separable interactions in each of 



2 



the distinct irreps of the normal state point group. For 
hexagonal systems with a Dq^ point group, this sum can 
be written as 
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(3) 



where d^^^"^ is the explicit form of the Aig or ex- 
tended s-wavc representation etc. The other irreducible 
representations present are /-wave, and the two dou- 
bly degenerate representations relate to d-wave and p- 
wavc. For the E2g correlations which we are interested 
in, the explicit {dx'2-y2 , dxy} form factors are {cosfc^; 

COS ^ COS -^^Y^ 



,V3sin%sin4^}. 
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Fermi surface instabilities.- For purely repulsive inter- 
actions, there is no superconducting instability to first- 
order in the interactions - i.e. at mean field level - since 
there are no negative eigenvalues of the interaction ma- 
trix. We therefore examine instabilities in the particle- 
hole channel towards the formation of phases with order 

parameters aJ)^_^, == Ek ^*''^c?[^''^(4+qcrCka'>: where t? 
labels the irrep. Having decomposed the interaction into 
separate irreps, we see that in the Random Phase Ap- 
proximation (RPA), the effective interaction will not mix 
different irreps. The effective interaction in RPA, Fk,k', 
will have the form 
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where x^^H^) the non-interacting susceptibilities, 
and the sum is over distinct irreps rj as in Eq. [3) The 
free susceptibility for each irrep diverges logarithmically 
at the van Hove filling, so the dominant instability is 
given by the one with the largest pre-factor. 

Mean Field Analysis.- When the Fermi surface is per- 
fectly nested, hexagonal symmetry dictates that there are 
three nesting vectors Qi,2,3 as defined in Fig. [Tal Thus, 
x(q) will be most divergent for any of these three vec- 
tors and this corresponds to charge or spin density wave 
order. However, as shown in Fig. [U finite second neigh- 
bor hopping destroys this perfect nesting and we may 
expect q = orders to be favored beyond some critical 
value of t2. We will see that nematic instabilities are 
dominant for large enough V and t2. While such insta- 
bilities can occur in the charge channel, there is the more 
exotic possibility of realizing a d -\- id nematic phase in 
the spin channel. We must invoke the spin degrees of 
freedom since the Hamiltonian must remain Hermitian, 
and we gain condensation energy utilizing both irreps. 
This so called (3 phase is in fact the most energetically 
preferable instability, and the corresponding mean field 
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FIG. 1. (a). The Fermi surface of the un-ordered state 
at the van Hove fiUing as the second neighbor hopping t2 
is tuned from negative (blue), to zero (black) where it is 
perfectly nested along three vectors Qi,2 = 7r(l,±%/3) and 
Qa = 27r(l,0), and finally to positive (pink), (b) The Fermi 
surface sphtting from the original black surface, into red and 
blue contours upon entering the d-\- id Pomeranchuk phase; 
the van Hove points are removed, and the spin winds twice 
around the Brillouin zone. The spin orientation is opposite 
on each Fermi surface, and the inner circle shows winding on 
one of these. 



Hamiltonian is 
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where, 5* 



k,t k,i/ 



and r* arc the usual Pauli ma- 



trices in the spin space. A is the magnitude of the order 
parameter written above, while d\^ are the d-wave form 
factors. By diagonalizing this matrix, we see that the 
Fermi surface splits into two parts, with the spin wind- 
ing twice in momentum space (see Fig. Ilbp . For the 
perfectly nested Fermi surface, the d -\- id density wave 
state may occur in either the singlet or triplet channels, 
with a mean field Hamiltonian of similar form to Eq. [SJ 



but with ^'j^ — (c^ '^k+q)' where Q is the commensurate 
ordering vector, and the Pauli matrices no longer acting 
in spin space. 

The static susceptibility for a particular irrep rj in the 
non interacting system is given by the expression 

d^k /(ek+q) - /(Sk) 
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where /(ek) is the usual fermi function, and the integral 
runs over the first Brillouin zone. Since the zero tem- 
perature integral is dominated by the saddle points in 
the dispersion we can obtain analytic expressions for the 
Pomeranchuk and density wave susceptibilities. We then 
explain how these connect to a numerical evaluation of 
Eq. iniat finite temperature. 

For q = orders, the expression for the susceptibility 
becomes 

»(q^0)= ^ '^'^ 
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FIG. 2. The coefficients of the logarithmically diverging sus- 
ceptibilities at zero temperature from Eq. [8] [9] [TT] and [12] 
This shows crossover from density wave (q = Q) to Po- 
maranchuk q = orders as t2 is varied. 



Following the method of Ref. [13] , we can expand in polar 
coordinates around a single one of the six equivalent van 
Hove points. Choosing the point (0, — 27r/-\/3), we set 
kx = rcosO and ky = — 27r/-\/3 + rsin6', and so, the k 
integral can be transformed into integrals over 9 and r. 
For the density of states (or ferromagnetic susceptibility) , 
upon carrying out appropriate transformations on the 
delta functions of Eq. [71 we obtain 
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where x = n* — fi. This shows the correct logarithmic 
divergence at the van Hove filling of /z = //*. Note the 
van Hove points disappear att2 > ti/9 when the M point 
is no longer a saddle, so we restrict our analysis to the 
range of parameter range t2 < ti/9. 

On the other hand, for the d-wave Pomeranchuk sus- 
ceptibility, the six van Hove points are no longer equiva- 
lent. When summed over the six saddle points, the extra 
factor in the integrand gives 1^^^""''^ « 12+0(^:2). Thus, 
in the limit /i — > /i*, the analytic expression for d-wave 
susceptibilities is 
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Note that this is the same for both the d^-^^y-i and dxy 
form factors, reflecting their symmetry protected degen- 
eracy. For commensurate density wave order, the suscep- 
tibility integral can be rewritten as 



(10) 

For the uniform density wave at any of the nesting vectors 
Q, a similar expansion in polar coordinates around each 
van Hove point with a cutoff to ensure < as dictated 



by the Fermi function gives the result 
x/3 
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where 20o is the angle between arcs of the Fermi surface 
at the M point, given by 2cos20o = {ti + "^t-i) / [ti — '^2) ■ 
This also has the requisite logarithmic divergence at the 
van Hove filling, but with a different coefficient to the 
density of states. 

Note that the dxy and dx^-y^ DW susceptibilities are 
no longer degenerate since the point group symmetry is 
broken by a finite ordering vector. However, they do 
transform as a vector under the point group symmetry. 
The constant magnitude of this vector implies that the 
d + id DW susceptibility is degenerate at all nesting vec- 
tors Q, and explicit evaluation gives 
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which represents the same relation between d-wave and 
s-wave susceptibilities as for q = orders. 

Since all of these susceptibilities diverge logarithmi- 
cally, the dominant instability will be determined by both 
the interaction strength for a given irrep (V^''-'), and the 
coefficient of the diverging susceptibility. These coeffi- 
cients are plotted in Fig. [^ showing that at ^2 > 0.04^1, 
the q = orders become dominant. These analytic re- 
sults at zero temperature provide valuable insight into 
the finite temperature values of the susceptibility. At fi- 
nite temperatures the logarithmic divergences are tamed, 
but susceptibilities are still peaked strongly at the van 
Hove filling. Numerical evaluation of these finite T sus- 
ceptibilities shows that the maximum values of x are pro- 
portional to coefficients shown in Fig. [2| We can there- 
fore determine the phase diagram by using a Stoner cri- 
terion for each phase. The result is a rich phase diagram 
in the plane of 1^ vs. ^2, with I = orders dominant 
at small values of V, while higher angular momentum 
I — 2 particle hole condensates are favored when longer 
range interactions are larger. The transition between 
these phases takes place at a critical nearest neighbor V 
given by F^^fx^'Kq) = i^*X^'''(q) > t^X°(q), which 
is around V* ~ 0.8U. Numerical minimization of the 
mean field free energy show that the transitions between 
these phases are first order at zero temperature, but the 
transition into each phase is continuous as a function of 
temperature. 

Landau- Ginzburg theory - Having determined that the 
nematic and dDW instabilities are dominant for large V , 
we now ask what combination of the dx2_y2 and dxy or- 
der parameters is preferable. Our numerical calculations 
confirm that these transitions are continuous as a func- 
tion of temperature, so we can safely truncate a Landau- 
Ginzburg free energy expansion at low order. The pres- 
ence of a two component order parameter along with the 
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FIG. 3. Phase diagram of the model in Eq.[l]as a function of 
nearest neighbor interaction V and second neighbor hopping 
t2. At low values of V , the uniform or zero angular momen- 
tum particle hole condensates dominate, while the time re- 
versal symmetry breaking I = 2 condensates dominate above 
a critical V/U . All phase boundaries are first order lines at 
zero temperature. 



Cgi, symmetry, dictates that the expansion for the q = 
Pomeranchuk order parameters must be of the form 



J-=a(r-r,)(|Ai|2 + |A2|2)+6i(|Ai|2 _ 
+ fe2(A*iA2-AiA;)% (13) 

up to fourth order where Ai and A2 are the dx2_y2 
and dxy components of the order parameter. The sign of 
the coefEcicnt 62 determines which combination of the or- 
der parameters is present; for 62 > 0, the sum Ai ± iA2 
minimizes the free energy, whereas for 62 < either a 
dxy or dx2_y2 order results. These coefficients can be de- 
termined microscopically [isj . and in a manner exactly 
analogous with superconductivity [1], we get bi = 
and b2 = where > is a trace over four Green 
functions. Thus, the d + id Pomeranchuk state is fa- 
vored at the transition, and numerical minimization of 
the mean field free energy suggests that this state per- 
sists deep below Tc since it gains maximum condensation 
energy. Similar considerations favor the d + id density 
wave state. 

Discussion.- We have shown on analytical footing how 
higher angular momentum particle hole condensates can 
be realized from models with extended interactions on 
hexagonally symmetric lattices. The symmetry protected 
degeneracy of the d-wave representations means that the 
d + id time reversal symmetry breaking phases are pre- 
ferred, in a manner that is analogous to superconductiv- 
ity. 

The full phase diagram in the plane vs. ^2 is shown 
in Fig. [3] This provides a unified view of the efi'ects 
of longer range interactions as bandstructure effects are 
tuned. When the Fermi surface is approximately per- 
fectly nested, commensurate density wave order is dom- 
inant. For low values of V, a spin density wave forms 



at any of the three nesting vectors or some combina- 
tion of them [l5| . Meanwhile, higher angular momentum 
d + id density waves are favored by longer ranged interac- 
tions. This can be either a singlet or triplet density wave, 
with the triplet states accompanied by a Goldstone boson 
due to the broken spin rotation symmetry. Furthermore, 
there can be an analog of the time reversal symmetry 
preserving quantum spin Hall state, with opposite spins 
winding with different chirality {d + id for up and d — id 
for down spins respectively) [l9j . 

However, as the nesting is destroyed by finite ^2, the 
q = orders are favored, with an analogous crossover 
from I = ferromagnetism to an ^ = 2 chiral nematic 
phase as the interaction strength is increased. The latter 
is the f3 phase - a, d + id Pomeranchuk instability which 
occurs in the spin channel. This is a metal with dy- 
namically driven spin orbit coupling, i.e. one that spon- 
taneously breaks time reversal and SU (2) spin rotation 
symmetries. We note that these Pomeranchuk phases 
have been observed as same sub-lattice instabilities in 
FRG studies of Kagome lattices, which would suggest 
that these infinitesimal interaction results may persist at 
stronger coupling 13 1 . 

While we have considered here the particular case of 
hexagonal systems, it is likely that non-trivial particle 
hole condensates can occur in cubic lattices which allow 
for three dimensional t2g irreps. It is likely, therefore, 
that the (3 phase, which makes use of each of the irreps 
in the spin channel will be the favored ground state at 
a Pomeranchuk instability. We shall present the analysis 
of three dimensional systems elsewhere. 
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